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Abstract. Constraint Programming (CP) solvers typically tackle opti¬ 
mization problems by repeatedly finding solutions to a problem while 
placing tighter and tighter bounds on the solution cost. This approach 
is somewhat naive, especially for soft-constraint optimization problems 
in which the soft constraints are mostly satisfied. Unsatisfiable-core ap¬ 
proaches to solving soft constraint problems in SAT (e.g. MAXSAT) 
force all soft constraints to be hard initially. When solving fails they re¬ 
turn an unsatisfiable core, as a set of soft constraints that cannot hold 
simultaneously. These are reverted to soft and solving continues. Since 
lazy clause generation solvers can also return unsatisfiable cores we can 
adapt this approach to constraint programming. We adapt the original 
MAXSAT unsatisfiable core solving approach to be usable for constraint 
programming and define a number of extensions. Experimental results 
show that our methods are beneficial on a broad class of CP-optimization 
benchmarks involving soft constraints, cardinality or preferences. 


1 Introduction 

Earlier work on unsatisfiable cores for Maximum Satisfiability (MAXSAT) has 
shown that it is advantageous to consider soft constraints to be hard constraints 
initially, solve the problem using a modern SAT solver, and use the resulting ev¬ 
idence of infeasibility to see which (temporarily hard) constraints are conflicting 
with each other, and soften them again only as necessary [12]. 

In this paper we extend the unsatisfiable cores algorithm from MAXSAT to 
Constraint Programming (CP). CP handles soft-constraint problems as mini¬ 
mization problems where the objective is a count of violations, the counts being 
derived from either reified primitive constraints (whose enforcement is controlled 
by an auxiliary variable) or soft global constraints (for examples of soft global 
constraints and their propagation algorithms see Van Hoeve [28]). 

One reason to expect that unsatisfiable cores will help in CP is that propa¬ 
gation solving relies on eliminating impossible (partial) solutions, but unfortu¬ 
nately when most constraints are soft then most solutions cannot be ruled out 
definitively and so propagation has little effect. Making as many constraints as 
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possible hard, should improve the propagation behaviour. Conversely, for the 
approach to be successful the solver needs to be able to prove infeasibility, if this 
is easy to do repeatedly then unsatisfiable cores will be highly effective, but if it 
requires a lot of search then it should be put off for as long as possible! 

We work in the context of a Lazy Clause Generation (LCG) solver, because 
the LCG solver can easily ‘explain’ why failures occurred, which is useful because 
it tells us which (temporarily) hard constraints should be made soft again. LCG 
is a hybrid approach to GP that uses a traditional ‘propagation and search’ con¬ 
straint solver as the outer layer which guides the solution process, plus an inner 
layer which lazily decomposes GP to Boolean satisfiability (SAT) and applies 
learning SAT solver technology to reduce search [24125]. 

The contributions of this paper are: 

— We translate the basic unsatisfiable core approach of SAT to CP solving. 

~ We extend the basic unsatisfiable core approach to a nested version which 
more aggressively makes soft constraints hard. 

— We discuss how we can use the unsatisfiable cores generated to improve the 
estimation of the objective function in CP search. 

— We give experiments showing that for some CP optimization problems the 
unsatisfiable-core approach is significantly better than branch and bound. 

2 Lazy Clause Generation 

We give a brief description of propagation-based solving and LCG, for more 
details see We consider problems consisting of constraints C over integer 
variables cci, ..., Xn, each with a given finite domain Don^{xi). A feasible solution 
is a valuation 9 to the variables, which satisfies all constraints C, and lies in the 
domain Dorig ~ Llorig(^l) x . . . X dorig(^n)5 i-6. 9{Xi) (z: D^^igi^Xi^. 

A propagation solver maintains a domain restriction D{xi) C Dong{xi) for 
each variable and considers only solutions that lie within D = D{xi) x ... x 
D{xn)- Solving interleaves propagation, which repeatedly applies propagators to 
remove unsupported values, and search which splits the domain of some variable 
and considers the resulting sub-problems. This continues until all variables are 
fixed (success) or failure is detected (backtrack and try another subproblem). A 
singleton domain D where all variables are fixed corresponds to a valuation Ojo 
where Bjj^Xi) = Vi when D{xi) = {ui}, i S l..n. 

Lazy clause generation is implemented by introducing Boolean variables for 
each potential value of a CP variable, named [xi = j], and for each bound, 
[xi > j]- Negating them gives [xi ^ j] and [xi < j — 1]. Fixing such a literal 
modifies D{xi) to make the corresponding fact true, and vice versa. Hence the 
literals give an alternate Boolean representation of the domain, which supports 
reasoning. Lazy clause generation makes use of clauses to record nogoods. A 
clause is a disjunction of literals, which we will often treat as a set of literals. 

The high-level solving algorithm LCG, including propagation, search, and 
nogood generation, is shown as Algorithm It is a standard CP branch-and- 
bound search, except that propagation (Propagate) must return a nogood N 
as shown, explaining any failures that are detected by propagation. Propagation 




Algorithm 1 CP branch-and-bound with clause learning and backjumping 
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function LCG(C, D, c, y) % initial constraints, domains and objective 

S' -^ [] % empty stack of domains per decision level 

9 none % best solntion found so far, initially none 

loop 

% the call below updates the implication graph and N, not shown explicitly 
D -s— Propagate(C, D) 

if D = 0 then 

% failure, nogood is A —>■ false where decision_level{l) > 0 for all 1 G A 
if A = 0 then % conflict occurred at level 0 

return 6 % no further improvement possible 

else 

{L, M) Analyze(A) % make lUIP nogood L —>■ I where M = {1} 
pop S until reaching highest decision level of literals in L or 0 
pop D from S % backjump 

C ^ Learn(C, L,M) % add redundant constraint to problem 

end if 

else if D is a singleton domain then 

% found solution, record it and restart with tighter objective constraint 

9 i — 9d 

pop S until reaching decision level 0 
pop D from S 
C^Cu{c^y <c^e(y)} 
else 

% reached a fixed point, execute the user’s programmed search strategy 
push D onto S 
D -s— Decide(D) 

end if 
end loop 
end function 


30: function Analyze(A) 

31: conflictJevel max„g]v decisionJevel{n) 

32: while there are multiple n £ N with decisionJevel{n) = conflictJevel do 

33: let L ^ I be the most recent unprocessed propagation at conflictJevel 

34: if no such propagations remain unprocessed then break end if 

35: if / G A then A ^ (A - {/}) U L end if 

36: end while 

37: return ({n : n £ N, decisionJevelin) < conflictJevel}, 

{“in : n £ N, decisionJevel{n) = conflictJevel}) 

38: end function 


39: function Learn(C, L, {!}) 
40: return C U {L —>■ Z} 

41: end function 






must also record an implication graph showing the reasons for each propagation 
step, and for each literal which is fixed, its decision level as the value of [S'! at 
the time of fixing. Conflict analysis derives new redundant constraints to avoid 
repeated search, and, as a side effect, modifies the backtracking procedure to 
backjump or restart solving at an appropriate point close to the failure |24) . 

The Analyze procedure reduces the information from the failure nogood 
N —>■ false, and the implication graph, into a lUIP nogood, which can be learnt 
as a new redundant constraint. It considers propagations at the conflict level, 
which is the highest level of any literal in N. Working in reverse chronological 
order, for each propagation L ^ I, where the propagated literal I occurs in N, 
this literal is replaced by its reason giving {N — {1})\JL. The process stops when 
there is at most one literal in N whose decision level is the conflict level, leaving 
a clause which propagates to fix that literal to its opposite value. 

3 Soft Constraint Optimization 

Soft constraints are constraints which should be respected if possible. When 
not all soft constraints can hold simultaneously we attach a cost to each viola¬ 
tion. In the resulting optimization problem the overall cost is to be minimized. 
Soft constraints may be intensional or extensional. An intensional constraint is 
an equation or predicate capturing the desired relationship between variables, 
whereas an extensional constraint is written as a table with columns for the 
variables of interest, explicitly listing the allowed or disallowed tuples. 

Specialized solvers have been highly successful for soft-constraint problems 
in extensional form. All of these solvers attempt to discover conflicts between 
soft constraints, or unsatisfiable soft constraints, by using what are essentially 
lookahead approaches, followed by appropriate reformulation that exposes the 
increased lower bound on solution cost due to the conflict or violation. 

For WCSP, in which each extensional table contains a weight column giv¬ 
ing the cost to be paid if the row holds, the best solver seems to be tool¬ 
bar / toulbar2 |13I17] . It is based on a branch-and-bound search with consistency 
notions, where (loosely speaking) a variable is consistent if the costs of the min¬ 
imum cost value(s) have been subtracted from the tables involving the variable 
and moved into the lower bound, thus fathoming unpromising branches. 

For MAXSAT, good solvers in a recent evaluation [3] included akmaxsat [16] 
and MaxSatz [20] variants. Essentially they use lookahead, with unit propagation 
and failed literal detection, to improve the lower bound [18119] . In restricted 
cases they use MAXSAT resolution, in which conflicting clauses are replaced 
by a unified clause plus compensation clauses H]. WCSP solvers are also highly 
effective on MAXSAT, since MAXSAT is a special case of WCSP. 

Recently there has also been considerable interest in decomposing MAXSAT 
to SAT, usually with an unsatisfiable-core approach [2112122123] . Because they 
use learning instead of lookahead (and other improvements such as activity-based 
search [M]), they have a considerable advantage over the previously-described 
approaches. On the other hand they do not employ reformulation, and not all 
problems are suitable for unsatisfiable-core searches. 








Pseudo-Boolean Optimization (PBO) is also promising for MAXSAT, which 
is a special case of PBO. In particular the Weighted Boolean Optimization 
(WBO) framework is an application of PBO to soft-constraint problems, 
using some of the specialized techniques discussed above. Another option is de¬ 
composition to SAT via the PBO solver MiniSAT-|- [3, which could be useful if 
unsatisfiability-based methods aren’t applicable to a particular problem. 

In this research we extend certain of the above techniques to intensional soft 
constraints. Modelling with intensional constraints has many advantages, (i) it is 
much easier since constraints are expressed in a natural way, (ii) it handles more 
constraints, since decomposition to extensional form is not always practical, and 
(hi) it can be more efficient, since propagation is a reasoning task as opposed 
to an expensive table traversal. It also has some disadvantages, (i) propagators 
must be implemented for each type of intensional constraint, and (ii) due to the 
many ways that constraints can interact, reformulation is difficult. 

We consider solving combinatorial constrained optimization problems with 
pseudo-Boolean objective (COPPBO). A COPPBO (x,y,D,C,c) consists of 
a vector x of general variables Xi, i G l..m, a vector of y of Boolean vari¬ 
ables Hi, i G l..n which appear in the objective, an initial finite domain D = 
D{xi) X ... X D{xm) X D{yi) x ... x D{ym), a set C of constraints Ci, i G l..k 


and an objective z = cry 
stant weighting factori 


to be minimized, where c consists of positive con- 
COPPBO problems encompass MAXSAT, partial 
MAXSAT, weighted partial MAXSAT, WBO and PBO. 

An important class of COPPBO problems are soft constraint optimization 
problems (x, D, H, S, c) given by a set of hard constraints H and a vector of 
soft constraints S, with corresponding weight vector c such that Ci is the cost of 
violating soft constraint Si, i G l..n. The aim is to find a solution 0 G D to the 
variables [xy], which minimizes z = c’^y, subject to H U {^pi -G Si : i G I..n}, 
where y consists of introduced relaxation variables for the constraints in S. Note 
that a CP system supporting constraint Si can be straightforwardly extended 
to support the softened form ^pi -G Si through half-reification [TO] . 


4 Basic Unsatisfiable Cores Algorithm 

An unsatisfiable core is a clause which contains only literals in y. This clause 
forces an objective variable to be true, and must add some positive value to the 
objective. Note that clauses containing a literal —^pi are not unsatisfiable cores. 
The unsatisfiable cores approach to optimization originally arose for solving a 
MAXSAT problem, which is, given a set of soft clauses S, find a solution which 
satisfies the maximum number of soft clauses. 

The basic unsatisfiable core solver consists of the procedures in Algorithm 
which are called by the high level solver of Algorithm [T] and essentially modify 
the decision procedure based on information from conflict analysis. Each attempt 
fixes all unfixed variables in y, that have never appeared in an unsatisfiable core, 

^ In calculating c^y we take false = 0 and true = 1. 

^ We make the coefficients a positive by negating Boolean literals if necessary. 






Algorithm 2 Basic unsatisfiable core algorithm (relative to Algorithm]^ 
Require: F — {yi,... ,yn} initially 

1: function Learn(C,L, M) where \M\ > 1 (otherwise fall back to Algorithm[^ 

2: F F — M % remove candidates that have appeared in an unsatisfiable core 

3: return C % unchanged constraint set, to avoid risk of learning duplicates 

4: end function 


Require: F = set of yi literals which have never appeared in an unsatishable core 
5: function DEClDE(_D(a:i) x ... x D{xm) x D{yi) x ... x D{y„)) 

6: if decisionJevel = 0 and exists yi £ F with D{yi) = {false, true} then 

7: for all such yi restrict the corresponding domain D{yi) to {false} 

8: else 

9: restrict some other domain according to user’s programmed search 

10: end if 

11: return D{xi) x ... x D{xm) x D{yi) x ... x D{y„) 

12: end function 


to false, and solves the resulting problem. This either finds a solution (which 
should be of low cost), or it detects that the problem is unsatisfiable. In a 
learning solver such as a SAT or LCG solver, by fixing the y-variables as a 
(possibly) multiple decision in an artificial first decision level, failure occurring 
at this level generates, as a side effect, a new unsatisfiable core. This continues 
until solutions are found, or the original problem is proved unsatisfiable. 

We have to modify the standard LCG solver to allow multiple simultaneous 
decisions when branching in procedure Decide. The Analyze procedure returns 
generalized 1UIP nogoods L ^ M where L is a set of literals treated as a 
conjunction, and M a set treated as a disjunction, e.g. aA6 —>■ cVd. The code for 
Analyze in Algorithm [^already handles this case, as line 34 will cause the loop 
to exit when only decisions remain. This line is unnecessary for search without 
multiple simultaneous decisions. Note also that, for the basic unsatisfiable core 
algorithm, we will only ever generate generalized lUIP nogoods where L = 0, 
but we will use the more general form in the next section. 

Algorithmj^keeps track of F, the set of optimization variables that have never 
appeared in an unsatisfiable core. The new post-analysis handler Learn(C, L, M) 
handles the case where \M\ > 1, by removing variables in M from F. Unlike the 
lUIP case with \M\ = 1, it does not learn the new nogood L —>■ M since this may 
already be in the clause database, because two or more literals in M may have 
been set false simultaneously (propagating the database precludes single wrong 
decisions that violate a clause, but this does not extend to multiple decisions). 


Example 1. The MAXSAT instance (all constraints soft) in the left column is 
entered as on the right, with objective z = j/i -b 1/2 + 2/3 + 2/4 to be minimized. 
Ci = C2 = aW h yiV 2/2 V a V 6 

C^ = —-a C4 = a 2/3 V 2/4 V a 

Here C 3 and C 4 are clearly in conflict, but given the choice it is better to relax 
C 3 so that Cl and C 2 can be satisfied simultaneously. At the top level the solver 
creates the multiple decision (simultaneously) 2/1 = false, ..., 2/4 = false and 









(a) (b) 

Fig. 1: Two implication graphs from solving the soft constraint problems of: (a) 
Example and (b) Example assuming all soft constraints are satisfied. 


solves. This fails with unsatisfiable core 2/3 V 2 / 4 , which is the generalized lUIP 
nogood resulting from the implication graph in Figure [^a). 

On the next attempt it sets only 2/1 = false, 2/2 = false, because 2 / 3 , 2/4 
have appeared in an unsatisfiable core. The only possible solution, under these 
assumptions, is b = false, a = true, 2/3 = true, 2/4 = false with cost 1. 


Although the initial solutions found by the unsatisfiable core algorithm are 
frequently of low cost, the algorithm does not replace the need for a traditional 
branch-and-bound approach (or equivalently the solving of a series of satisfaction 
problems with tighter and tighter bounds on the cost). When we have a (best 
known) solution 0 , the objective bound c^y < c^d(y) needs to be propagated. 
This is standard for CP systems, although MAXSAT solvers typically use SAT 
decompositions of the objective using BDDs or sorting networks [52]. 

Example 2. Consider the trivial instance (original on left, reified on right). 

Cl = —-a C 2 = ~'h 2/1 V ~'a 2/2 V -^b 

C 3 = aW b C 4 = a\/ b 2/4 V “'C 

The only unsatisfiable core is 2/1 V 2/2 V 2 / 3 , discovered from the implication graph 
in Figure [^b). The solver will never try c = true because 2/4 does not participate 
in any unsatisfiable core. After discovering the core, search will set 2/4 = false 
and propagate ^c. Search will continue finding solutions with a = b = true at 
cost 2 or any other valuation to a, b at cost 1. Unsatisfiable-core algorithms do 
not distinguish between these cases. 


Superficially the algorithm is a static search which fixes the variables in y to false 
before proceeding, but is quite different because (i) any propagation resulting 
from fixing the y-variables is done after all are fixed, which is enormously more 
efficient than one-by-one, especially when global constraints are involved, and 
(ii) static search backtracks only as far as necessary, so it will try all values for 
the tuple ( 2 / 1 ,..., 2/n) in lexical order, which is impractical for large n. 

In the best MAXSAT implementations [22I23| the relaxation variables for a 
clause were not created until the clause had appeared in an unsatisfiable sub¬ 
set, with the information about conflicting clauses being extracted from proof 
traces rather than from the presence of their relaxation literals in a learnt clause. 
This was sensible for MAXSAT considering that MAXSAT problems are ‘tali’. 













i.e. they have more clauses than variables, hence more relaxation variables than 
ordinary variables, unless relaxation variables are created lazily. 

On the other hand CP has much less reliance on decomposition due to its 
richer constraint library and problems are frequently ‘wide’, i.e. they have more 
variables than constraints, particularly when there is extensive use of global 
constraints. So relatively few relaxation literals are required and it was not worth 
going to the trouble of reformulating the problem ‘on the fly’, so we opted for 
the simpler approach of the artificial decision level, which allows conflict analysis 
to collect relaxation literals into unsatisfiable cores in a natural way. 

5 Nested Unsatisfiable Core Algorithm 

With the previously outlined approach to unsatisfiable cores it can happen that 
all or most variables in y are covered by one or more unsatisfiable cores. This 
is particularly likely in problems with a lot of structure or symmetry such that 
each variable is involved in a similar set of constraints. In such cases, once all 
unsatisfiable cores have been enumerated, all soft constraints have reverted to 
being treated as soft, and the problem is no easier than originally. 

Hence we define a nested version of the algorithm in which soft constraints 
can be made hard during search rather than only at the top level. This involves 
two new concepts, (i) active unsatisfiable cores which describe a conflicting set 
of soft constraints where we do not know which will be violated, as opposed to 
inactive where a particular violation is known and has already been penalized, 
and (ii) contingent unsatisfiable cores which are only unsatisfiable cores in the 
current subproblem, that is, under the current search assumptions. 

Note that in the clausal view a contingent unsatisfiable core is simply any 
clause where only i/i literals remain, because other literals are already false. Then 
at least one of these yi must be true, i.e. it is an unsatisfiable core. It is initially 
active but goes inactive when at least one of these yi becomes true. 

In the revised algorithm, an objective variable yi may be set false initially 
by a multiple decision, but then reverts to unconstrained when search discovers 
it is part of an unsatisfiable core and backtracks. It will no longer be set to false 
since it appears in an active unsatisfiable core. But it may again be set false at 
a deeper decision level if all the unsatisfiable cores involving yi go inactive. 

Example 3. Referring to Example given the unsatisfiable core ?/i V 2/2 V j/ 3 , on 
the next attempt 2/4 has not been involved in any core and so is set to false on 
level 1, hence c = false. On level 2, suppose search tries a = true hence 2/1 = true 
and reaches a fixed point. Since 2/1 V 2/2 V 2/3 is now satisfied, there is no evidence 
that 2/2 or 2/3 needs to be true, and a new multiple decision is made as level 3 
which sets 2/2 = 2/3 = fctlse. Solving continues, finding b = false and cost 1. 

Example 4- Consider minimizing a + b + c subject to the clauses 

ay by d by cy ^ay d, 

which arises from the partial MAXSAT instance with soft constraints ^a, —•b, -ic 
and hard constraints as above. Falsifying a, b, c returns the unsatisfiable core 


Algorithm 3 Nested unsatisfiable core algorithm (relative to Algorithm]^ 
Require: = count of active contingent nnsatisfiable cores involving yi, initially 0 

Require: Yi = stack of all contingent unsatisfiable core involving yi, initially empty 


Require: When literal yi goes true due to propagation or decision, 

1: for {L —>■ M} in stack Yi where {L —> M} is still active do 
2: mark {L —>■ M} as inactive, and for all yj € M decrement Cj 

3: end for 

4: function Learn(C,L, M) where \M\ > 1 (otherwise fall back to Algorithm[^ 

5: for all yi £ M push the clause {L —> M} onto stack Yi and increment ai 

6: return C % unchanged constraint set, to avoid risk of learning duplicates 

7: end function 

8 : function DEClDE(_D(a:i) x ... x D(xm) x D{yi) x ... x D{y„)) 

9: if exists yi with a; = 0 and D{yi) = {false, true} then 

10: for all such yi restrict the corresponding domain D{yi) to {false} 

11 : else 

12: restrict some other domain according to user’s programmed search 

13: end if 

14: return D{x\) x ... x D{xm) x D{y\) x ... x D{y„) 

15: end function 


ay by c, so that on the next attempt, nothing can be fixed at the top level. This 
is exactly the problem that the nested algorithm tries to address. 

Since a multiple decision is not applicable the ordinary decision procedure 
sets a = true on level 1, resulting in d = true, and reaches a fixed point. Because 
a V 6 V c is now satisfied, level 2 is a multiple decision setting b = c = false, but 
this immediately fails with reason by cy -^d, because d was already true. Solving 
backtracks past the multiple decision and records the new unsatisfiable core by c 
(contingent on d = true), then continues, using the ordinary decision procedure, 
eventually finding a solution of cost 2 (with a and either b or c = true). 

The benefit of this approach is that even if all objective literals eventually appear 
in an unsatisfiable core, we still aggressively set them to false as soon as all the 
active (contingent) unsatisfiable cores they appear in are satisfied. Conversely, 
it may be there are too many contingent unsatisfiable cores to be enumerated 
by this method, leading to thrashing in the solver. 

The revised solver replaces Algorithm with Algorithm which maintains 
activity counts ai for each variable yi. When a new core becomes active through 
discovery in conflict analysis, the counts for all variables involved are incre¬ 
mented. When the core goes inactive, the counts are decremented, based on a 
cross-referencing data structure consisting of stacks Yi. The counts Ui and stacks 
Yi must be trailed so that they are reset correctly on backjumping. The Decide 
procedure only considers yi variables with zero activity counts as candidates for 
a multiple decision, or if none exist it makes a normal search decision. 








6 Notification-based Nested Algorithm 


In the algorithms discussed to this point, we did not ‘learn’ unsatisfiable cores 
by adding them to the constraint store, because we did not want to risk learning 
duplicates, leading to duplicated propagation work. This is frustrating for the 
nested algorithm since contingent unsatisfiable cores are discarded on backtrack¬ 
ing, even though they are valid nogoods which may capture new information. 

Example 5. In Example the first unsatisfiable core is a V 6 V c which holds 
new information not explicit in the original formulation, that can help future 
search. The next (contingent) unsatisfiable core is 6 V cV —■(! which is a duplicate 
of a clause in the original problem. Other than searching the constraint store or 
using a hashing scheme, we have no way of distinguishing between these cases. 

Furthermore, with the previously-defined algorithms, clausal constraints from 
the constraint store are not used as contingent unsatisfiable cores except when 
they are violated by a multiple decision. To tackle this problem we modify the 
clausal propagators to issue a notification whenever an ordinary clause becomes 
an active contingent unsatisfiable core, that is, when the last of the non-j/i literals 
in the clause goes false. 

In essence we treat the clause C = X \/ Y, where Y are the yi literals in C 
and X the others, as X \/ I and ^l V Y, where I is a new literal. When I is set 
true by unit propagation, the clause C becomes a contingent unsatisfiable core. 
This is preferable because any multiple decisions made by the unsatisfiable core 
algorithms take into account all current information and do not lead to trivial 
failures. Then it is safe to learn all clauses resulting from conflict analysis. 

Example 6. Revisiting Example the first unsatisfiable core aV bW c has to be 
derived in the usual way by conflict analysis resulting from a multiple decision, 
but on the second attempt, as soon as d is set true by propagation from a, the 
original clause bW cM -^d becomes an active contingent unsatisfiable core and is 
immediately recorded against the literals b and c as evidence that one of them 
must be true. This avoids the failed search with b = c = false. 

7 Enhanced Lower Bounding 

At each node of the branch and bound tree we need to check the linear constraint 
c^y < c^O(y) where 6 * is the current best solution and fathom (backtrack) when 
the constraint detects failure. This compares the current solution cost, or if we 
only have a partial solution then a conservative lower bound on the solution 
cost, with a conservative upper bound on the optimal solution cost. Usually the 
conservative lower bound is obtained by taking all unfixed yi as false. 

Information from unsatisfiable cores can be used to strengthen the lower 
bound. Suppose that some subset e.g. y 2 , ys and ys are unfixed but we have 
the unsatisfiable core 2/2 V ?/3 V j/ 5 . Then clearly it is too conservative to assume 
that all are false and we can increase the estimate by at least min(c 2 , C3, C5), 


Algorithm 4 Disjoint unsatisfiable core-based bound-strengthening 

function Disjoint(c 
for i in \..l do 

ai -s- miny-ea^ Cj 

for all yj in Gi do Cj Cj — ai end for 
u u — ai 

end for 

return c^y < u 
end function 


hopefully leading to earlier fathoming. This is the basis of disjoint inconsistent 
subformula approaches which have been used for MAXSAT [19]. 

Example 7. Referring to Example]^ after a finding the first solution of cost 1, 
the unsatisfiable core yi V 2/2 V j/3 implies that any solution will have cost > 1 so 
no further improvement is possible. Solving can then terminate immediately. 

Note that our treatment is somewhat more formal as LCG solvers require 
reasons for fathoming. Thus it is inadequate just to increase the estimate, we 
have to derive a globally true but tighter objective constraint. Suppose we have 
an objective constraint L = GVi < u where u is the current upper bound, 

and a collection of active unsatisfiable cores Ci, ..., Cg. Then considering core 
Ci as a linear constraint Gi = produce a tightened 

objective constraint as a linear combination of L and Gi, i S 1 . 1 . 

Example 8. Suppose the problem is minimizing 2 yi + 82/2 + 82/3 -I- 62/4 with u = 7 
so that the objective constraint is U = 2 yi -|- 82/2 + 32/3 -I- 62/4 < 7. Unsatisfiable 
core Cl = 2/1V 2/3 V 2/4 gives the linear constraint Gi = —yi — 2/3 — 2/5 ^ ~1- Then 
a strengthened objective constraint is obtained as the Fourier elimination m of 
2/1, by summing the constraints U' = U -|-2Gi = 82/2+2/3 + 32/5 < 5. Unsatisfiable 
core C2 = 2/2 V 2/3 V 2/4 gives G2 = -2/2 - 2/3 - 2/4 < 1 and eliminates 2/3 giving 
U" = U' + G2 = 22/2 + 22/5 < 4, which is tighter while still globally true. 

We use two methods to strengthen the objective constraint U, (i) a heuris¬ 
tic method and (ii) an exact method. Note that the tightened inequality is 
contingent upon the non-yi literals of any contingent unsatisfiable cores that 
contributed to tightening, so whenever we have to explain the actions of the 
tightened propagator U we have to add these literals to the explanation. 

Disjoint Unsatisfiable Core-based Lo-wer Bounding: The heuristic method, 
shown as Algorithm]^ starts by taking a working version of the objective upper- 
bound constraint U. Then for each Gi it eliminates from U, by the Fourier- 
Motzkin method [U, the cheapest variable that could be made true to satisfy 
Gi, using the current working coefficients as costs. This means adding the as¬ 
sumed cost of satisfying Gi into the estimate, then adjusting the assumed costs 
used from then on, to avoid double-counting. Examplej^illustrates the algorithm. 

The above algorithm is well known for weighted MAXSAT. We define an 
incremental version that modifies the objective constraint each time new active 





unsatisfiable cores are discovered. When unsatisfiable cores go inactive they are 
removed from the tightened inequality, which is necessary for correctness, since 
the tightened bound constraint is a consequence of the original bound constraint, 
not equivalent. After removing an inactive core, we found it essential to re¬ 
examine subsequently-added cores to see if they can contribute any additional 
strength. 

Example 9 . Continuing Example suppose later yi = true, then U" does not 
propagate, but U would have since it then becomes 3 y2 + Sya -I- 62/4 < 5 which 
immediately sets 2/4 = false. We roll back to U where we eliminated the hrst 
core involving 2/1, and now eliminate the remaining active core C2 = 2/2 V 2/3 V 2/4 
to obtain U'” = U -\- 3G2 = 2 yi + 2y4 < 4 , which propagates 2/4 = false. 

Linear Programming-based Lower Bounding: The strengthening proce¬ 
dure is an optimization problem over the coefficients ai discussed above, which 
can be solved to optimality using a Linear Programming (LP) solver to give the 
best possible fathoming based on the information available at each node. The LP 
has to be updated at each node with the latest set of unsatisfiable cores, noting 
that inactive cores can be left in, since it can see they are already satisfied. The 
LP can also contain other constraints at the modeller’s discretion. 

We define an LP constraint linear-program(G,c,y,z) which given a set of 
linear (in)equalities G over the variables y, an objective c^y and an upper 
bound z on the objective (based on the best solution found so far), enforces that 
all (in)equalities are satisfied and c^y < z. It executes when the bounds on y 
are tightened, and verifies that G can still hold, if not it detects failure with an 
explanation. It also verifies that there is still objective slack, if not it fathoms 
with an explanation. Then it prunes the y if possible, based on the slack. 

The linear_program propagator works similarly to the bound-strengthening 
procedure described previously, in that it derives new linear constraints L -|- 
choosing the vector a which minimizes the RHS of the resulting 
constraint. For the LP case the vector a and indeed the coefficients and RHS of 
the strengthened constraint are available directly in the dual solution after mini¬ 
mizing c^y subject to G. Thus the standard procedure of deriving explanations 
from dual solutions or unbounded dual rays is applicable mm- 

8 Experiments 

To evaluate whether unsatisfiable cores are useful for CP and whether our ex¬ 
tensions are helping, we compared standard branch-and-bound with the solvers 
described in Sections and With each of these solvers we tried standard 
lower bounding and each of the strengthened lower bounds from Section]^ 

The basic solver is a state-of-the-art LCG solver. Chuffed. We use activity- 
based search (VSIDS) for all experiments [ 53 ]. For maximization problems we 
negate the objective, so all are minimization. The experiments were run on a 
cluster of AMD 6-core Opteron 4184 at 2.8 GHz with time limit 3600 s, memory 
limit 2 Gbytes per core, and memory-outs treated as timeouts. Data files are 
available from http://www.csse.unimelb.edu.au/~pjs/unsat_core. 




Table 1 : Evaluating unsatisfiable-core solvers on combinatorial benchmarks 



fathoniing=std 

opt,s,sol,obj 

disjoint 

opt,s,sol,obj 

empty LP 

opt,s,sol,obj 

PSM (k=l) branch and bound 
basic unsat core 
nested unsat core 
nested+notification 

12,1117s, 16, -672 
12,1084s, 16, -642 
8,1943s, 16, -629 
10,1658s, 16,-644 

12, 1015s, 16, -674 
12, 966s,16,-643 
12, 1461s, 16, -643 
11, 1551s,16,-648 

11, 1214s, 16, -678 

11, 1285s, 16, -641 
7, 2353s, 16, -599 

12, 1341s, 16, -645 

PSM (k=2) branch and bound 
basic unsat core 
nested unsat core 
nested+notification 

2,3244s, 16, -654 
0,3600s, 13, -581 
0,3600s, 10, -559 
2,3167s, 16, -640 

1, 3375s, 14, -675 

1, 3375s, 13, -574 

2, 3161s, 13, -579 
2, 3157s, 16, -626 

1,3375s, 16, -724 
2, 3248s, 14, -567 
2, 3160s, 13, -596 

4,2973s,16, -602 

PHOTO branch and bound 

basic unsat core 
nested unsat core 
nested+notification 

10,2487s,30,-15.7 
11,2455s,30,-15.9 
10,2499s,30,-15.8 
12,2437s,30,-15.8 

10, 2492s, 30,-15.5 
14, 2211s, 30,-15.7 

17, 1781s,30,-15.9 

18, 1609s, 30,-15.9 

10, 2460s, 30, -15.6 
14, 2083s, 30, -15.8 
21, 1268s, 30, -15.9 

26, 926s,30,-16.0 

RLFAP branch and bound 

basic unsat core 
nested unsat core 
nested+notification 

1,3380s, 16, 11.0 
2,3154s, 16, 9.7 
2,3156s, 14, 9.3 
2,3154s, 14, 9.2 

1, 3379s, 16, 10.8 
3,3086s,16, 9.5 

2, 3170s, 15, 9.1 
2, 3174s, 15, 9.1 

1,3379s, 16, 10.8 
2, 3154s, 16, 9.7 

1,3375s, 14, 9.4 

2, 3175s, 14, 9.2 

ROSTER branch and bound 

basic unsat core 
nested unsat core 
nested+notification 

14,1316s, 20, 15.7 
16, 724s, 16, 15.4 
16, 724s, 16, 15.4 

16, 723s,16,15.4 

14, 1297s, 20, 15.6 
16, 724s, 16, 15.4 
16, 724s, 16, 15.4 
16, 725s, 16, 15.4 

14, 1197s, 20, 16.4 
16, 724s, 16, 15.4 
16, 724s, 16, 15.4 
16, 724s, 16, 15.4 

SUGIYAMA branch and bound 

basic unsat core 
nested unsat core 
nested+notification 

5, 99s, 5, 8.6 

5, 166s, 5, 8.6 

5, 128s, 5, 8.6 
5, 207s, 5, 8.6 

5, 106s, 5, 8.6 

5, 143s, 5, 8.6 

5, 5s, 5, 8.6 

5, 14s, 5, 8.6 

5, 121s, 5, 8.6 

5, 102s, 5, 8.6 

5, 63s, 5, 8.6 

5, 3s, 5. 8.6 


We tried the following combinatorial benchmarks: PSM (pattern set mining, 
16 instances) is given a set of training items each a vector of Booleans, find some 
vector which characterizes all items, or if fc > 1 find the best k vectors [T^ : 
PHOTO (30 instances) is given a set of people and soft constraints on who they 
stand next to, place them in a line for a photo; rlfap (radio link frequency as¬ 
signment, 16 instances) is assigning frequencies to channels with soft constraints 
that minimize interference [ 3 ; roster (20 instances) is finding a cyclic roster 
for a single worker over a number of weeks with soft work pattern constraints; 
and SUGIYAMA (5 instances) is a graph layout problem on layered graphs with 
soft no-edge-crossings constraints [ 27 ]. 

Table shows for each solver: ‘opt’ number of instances optimized, ‘s’ mean 
solving time (taking the timeout for instances which timed out), ‘sol’ number of 
instances for which any solution was found, and ‘obj’ mean objective (taking the 
objective from the worst solver for instances where no objective is available, not¬ 
ing that this may be too generous). The solver which solves the most instances, 
falling back to comparing times and so on, is highlighted. 

On these problems we see that with standard bound-estimation, we see that 
unsatisfiable cores is usually better than the unmodified solver but the improve¬ 
ment is not particularly dramatic. The best version of the unsatisfiable cores 
algorithm depends on the problem. Adding notification nearly always improves 
the nested algorithm, though SUGIYAMA is an exception which indicates an un¬ 
usual constraint structure (perhaps there are too many unsatisfiable cores). 

If the extra information from unsatisfiable cores is also used for bound¬ 
strengthening then dramatic improvements are possible. The best solver overall 
is the nested algorithm with notification and (initially empty) LP-based bound 












Table 2: Evaluating unsatisfiable-core solvers on industrial problems 



fathoming=std 

opt,s,sol,obj ,inf 

empty LP 

opt,s,sol,obj,inf 

redundant LP 

opt,s,sol,obj,inf 

LP only 

opt,s,sol,obj,inf 

CTT b&b 
basic 

nest 

nest+not 

0.3600s,32, 66843,0 
0.3600s, 3, 62468,0 
0.3600s, 1, 65485,0 
0.3600s, 1, 65233,0 

0,3600s,32, 69772,0 
0,3600s, 1, 65611,0 
0,3600s, 1, 65485,0 
0,3600s, 1, 65233,0 

22, 1332s,32, 82.9,0 

24, 1166s, 28, 9349,0 

24,1067s,29, 6045,0 
24, 1107s, 29, 6045,0 

13, 2734s, 32, 86.9,0 

8, 3059s, 10, 48750,0 

7, 3109s. 8, 57222,0 

9, 3094s, 9, 51673,0 

STEIN b&b 
basic 
nest 

nest+not 

0,3600s,13,265192,0 
0.3600s,13, 8432,0 

0.3600s, 13, 7657,0 

1.3443s,13, 6957,0 

0,3600s,13, 9102,0 

3,2777s,13, 8533,0 

4,2498s,13, 8438,0 

4,2495s,13, 6935,0 

2, 3088s, 13, 9001,0 

4, 2540s, 13, 8433,0 

4, 2503s, 13, 6503,0 

4, 2507s, 13, 5849,0 

8, 1764s, 10, 8448,0 

11, 1041s, 13, 3520,0 

11, 944s, 13, 3425,0 

12, 910s,13, 3422,0 

FCNF b&b 
basic 
nest 
nest+not 

0,3600s, 2,188675,0 
1.3556s,47,171065,0 
l,3560s,40,183401,0 
0.3600s,41,181917,0 

0.3600s,38,185854,0 
0.3600S.48,169844,0 
0.3600s,45,178483,0 
7.3329S.46,177765,0 

9, 3176s, 59,167292,0 

15, 2809s, 60,134390,0 

16, 2722s, 59,135616,0 
20, 2482s, 60,134105,0 

25, 2290s, 47, 157774,0 

26, 2180s, 48, 153666,0 
23, 2295s, 50, 153992,0 

28,2009s,50,154185,0 

NSP b&b 
basic 
nest 
nest+not 

3.3196s,29, 317,1 
3,3263s,26, 278,0 
3.3263s,27, 273,0 
6.3009s,27, 274,0 

3,3177s,29, 319,1 
8,2713s,26, 278,0 
8,2702s,27, 273,0 
8,2702s,27, 273,0 

2, 3162s, 30, 319,2 

8, 2596s, 30, 272,2 

7, 2591s, 30, 267,2 

8,2512s.29, 269,2 

1,3333s, 25, 344,2 

8, 2537s, 28, 272,2 

8, 2537s,28, 269,2 

8, 2519s,27, 273,2 


strengthening. We also see good results from the nested or basic algorithm and 
disjoint-based bound strengthening (without notification). The trade-off is that 
disjoint-based bounding is faster but sacrifices pruning power. Adding notifi¬ 
cation always helps LP-based strengthening, because the LP receives more in¬ 
formation, but never helps disjoint-based strengthening, because overlapping 
unsatisfiable cores slow down the algorithm without adding strength. 

We then tried some much more difficult industrial problems: CTT (curriculum- 
based timetabling, 32 instances) is finding a weekly repeating timetable for a uni¬ 
versity subject to various kinds of soft availability constraints and soft no-clashes 
constraints [7]; stein (Steiner network, 13 instances) is designing a connected 
network given a set nodes and arcs with a fixed (building) cost per arc [TS] ; fcnf 
(fixed-charge network flow, 60 instances) is designing a connected network with 
fixed (building) and also variable (operating) costs per arc [3^; and NSP (nurse 
scheduling problem, 32 instances) is designing a roster for a hospital ward based 
on the shift preferences of each individual nurse [29] . 

All of these problems use global constraints taken from gcc^ sequence, regular 
and network_flow. On CTT and NSP we utilize a hybrid search which considers 
each course/day sequentially, with activity-based search within courses/days. 

Furthermore the objective in CTT and NSP is not pseudo-Boolean as some yi 
are general integer. Then the unsatisfiable-cores algorithm expresses that e.g. all 
nurses should receive their first preference until we have evidence that this should 
be relaxed to the second preference for certain nurses and so on. We make the 
appropriate change to the multiple-decision algorithm, omitted earlier for clarity. 
Then unsatisfiable cores e.g. [yi > 3] V [ 1/2 > 2] say nurse 1 cannot receive 
1st or 2nd preference simultaneously with nurse 2 receiving 1st preference. For 
bounding we add a linearization e.g. l/2(i/i — 1) -f (?/2 — 1) > 1) into the LP. We 
only consider LP-based bounding in this experiment, not disjoint-based. 

These problems are extremely difficult to prove infeasible and so unsatisfiable- 
cores approaches were not highly successful initially (‘std’/‘empty LP’ columns). 
We addressed this with a hybrid CP/MIP approach, by adding a linear decom- 











Table 3: Comparing MIP solvers with enhanced CP solver 



CPLEX 

opt,s,sol,obj,inf 

SCIP (learning) 

opt,s,sol,obj,inf 

Chuffed (best solver) 
opt,s,sol,obj,inf 

PSM (k=l) 
PSM (k=2) 
PHOTO 

RLFAP 

ROSTER 

SUGIYAMA 

CTT 

STEIN 

FCNF 

NSP 

9,20618,16, -518,0 

1, 3375s, 13, -565,0 

3, 348Ss,30, -14.8,0 

0,3600s, 5, 10.4,0 

18, 365s,20, 0.5,0 

3, 1887s, 5, 8.8,0 

30, 482s,32, 81.9,0 

7, 1768s, 13, 3670,0 

45,1042s,60.111387.0 
30, 63s,30, 263,2 

7,2514s,15, -447,0 

3,3240s, 8, -428,0 

7,3216s,30, -15.4,0 
1,3417s, 8, 10.2,0 

17, 654s,20, 1.6,0 

5, 816s, 5, 8.6,0 

21,1580s,32, 81.9,0 

3,2770s,13, 3752,0 

33,1702s,60,111864,0 
29, 190s,30, 264,2 

12. 966s,16, -643,0 

4,2973s,16, -602,0 

26, 926s,30, -16.0,0 
3.3086s,16, 9.5,0 

16, 723s, 16, 1.6,0 

5. 3s, 5, 8.6,0 

24, 1067s, 29, 1474,0 

12, 910s,13, 3422,0 
28, 2009s, 50,142562,0 
8, 2512s,29, 267,2 


position of all CP constraints, including globals, as a redundant linear^program 
propagator (‘redundant LP’ column). We also evaluated leaving out the original 
CP constraints and using only the LP, so that Chuffed becomes similar to a 
learning MIP solver such as SCIP using unsatisfiable cores (‘LP only’ column), 
but missing advanced MIP cutting planes and rounding heuristics. 

Table shows the results of these experiments. We add the column ‘inf’ as 
number of instances proved infeasible due to hard constraints. With the enhanced 
globality due to the linear_program propagator, the unsatisfiable-cores algorithm, 
in particular the nested algorithm with notification, is a big improvement for CP. 
On NSP (which has preferences), CP is useless without unsatisfiable cores. 

Finally we consider MIP (without unsatisfiable cores) as an alternative to CP 
for solving soft-constraint problems. Table compare CPLEX 12.0 and SCIP 
2.1.1 with the best solver from each of the experiments described above. On 
the combinatorial benchmarks CP is clearly superior and much improved with 
our techniques. MIP was really only effective on the industrial problems. Given 
that timetabling and design problems require globality and that MIP employs 
many specialized and/or proprietary techniques, MIP should be the first resort 
for such problems. On the other hand CP with all our techniques is signihcantly 
improved and starts to look competitive, indeed on stein we beat MIP. On 
STEIN the ‘cuts’ added for LP-based bounding enforce the connectivity of the 
network and are similar to [HES], but our approach is much more generic. 

9 Conclusion 

We have translated unsatisfiable-core methods from MAXSAT to solve CP op¬ 
timization problems with pseudo-Boolean objectives, by making use of the fa¬ 
cility of LCG solvers to generate unsatisfiable cores. This provides one of the 
first approaches to soft intensionally defined constraint problems beyond branch 
and bound that we are aware of, apart from PBO/WBO |9I21) which support 
intensionally-defined linear constraints only. 

To gain the maximum advantage from unsatisfiable cores we needed to extend 
the method to generate and use unsatisfiable cores in the middle of search. This 
approach to optimization can be substantially better than the traditional branch 
and bound approach on intensionally defined optimization problems. With our 
extensions we saw a clear synergy between (i) aggressively assuming that soft 










constraints hold, and (ii) using the resulting information about unsatisfiable or 
conflicting soft constraints, for enhanced fathoming. 
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